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EVALUATION 


This  report  covers  the  study  and  experimental  evaluation 
of  a  new  method  of  nonlinear  modulation  of  analog  information 
to  provide  improvement  in  performance  over  conventional  modu¬ 
lation  techniques  such  as  PCM.  The  work  was  done  as  a  part 
of  the  Digital  Processing  portion  of  TPO  Number  11,  "Communica¬ 
tion  Signal  Processing".  In  particular,  the  requirement  is 
to  study  techniques  complementing  or  providing  cost,  effective 
technical  improvement  to  digital  equivalent  signal  processing 
undertaken  within  the  aims  of  TPO  Number  11.  In  light  of  the 
success  of  this  effort  as  described  in  this  report,  in-house 
experimentation  and  possible  contractual  effort  is  planned 
to  improve  the  power  of  the  technique  by  parameter  variation  and 
to  seek  out  appropriate  analog  signal  inputs  other  than  voice 
for  analysis. 


MILES  H.  BICKELHAUPT,  JR.^  ^ 
Effort  Engineer 
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SECTION  I 


INTRODUCTION 


In  this  report  we  are  concerned  with  modulation  techniques 
for  the  efficient  use  of  bandwidth  in  the  transmission  of  analog 
information. 

The  use  of  bandwidth  as  a  means  for  combating  noise  in  the 
transmission  of  information  has  been  known  since  the  invention 
of  FM,  the  first  practical  system  which  made  effective  use  of 
bandwidth.  Since  then  other  modulation  techniques,  notably. 

Pulse  Code  Modulation,  have  been  even  more  efficient  in  their 
bandwidth  utilization. 

FM  and  PCM  both  made  good  use  of  the  then  existing  technol¬ 
ogy  and  knowledge  of  modulation  theory.  In  the  interim  since 
the  invention  of  these  modulations  we  have  had  substantial  changes 
in  electronic  technology  and  an  enormous  increase  in  our  know¬ 
ledge  and  understanding  of  modulation  with  developments  in  infor¬ 
mation  theory.  The  question  that  we  have  addressed  has  been 
how  to  make  use  of  the  advances  in  digital  technology  and  theoret¬ 
ical  knowledge  to  develop  new  and  more  efficient  modulation  tech¬ 
niques  for  the  transmission  of  analog  data. 

The  type  of  system  which  we  postulated  has  the  general  struc¬ 
ture  which  is  given  in  Fig.  1.1.  The  first  step  in  the  process  is 
the  digitization  of  the  source  followed  by  digital  encoding.  The 
encoded  information  is  then  used  to  generate  waveforms  for  the  chan¬ 
nel.  The  digital  structure  permits  the  use  of  a  highly  nonlinear 
transformation  with  memory,  which  are  essential  elements  for  ef¬ 
ficient  use  of  available  bandwidth.  Note  from  the  figure  that  we 
use  the  term  "modulation"  in  a  rather  broad  sense. 
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Our  research  has  resulted  in  the  construction  of  a  bread¬ 
board  of  a  nonlinear  modulation  technique  which  provides  sub¬ 
stantial  improvement  over  FM  and  PCM  systems.  The  breadboard 
represents  the  realization  of  a  specific  design  of  certain 
general  modulator  design  principles  discussed  in  this  report. 

The  new  modulation  has  been  called  Multistream  Modulation  (MSM) 
for  reasons  which  will  become  obvious  when  it  is  explained 
below  in  the  text. 

The  basic  notion  behind  the  techniques  discussed  in  this 
report  is  that  after  a  signal  is  digitized,  i.e.  converted  into 
bits,  certain  of  the  bits  are  more  important  in  the  representa¬ 
tion  of  the  signal  than  others.  This  notion  is  coupled  with  the 
concept  of  applying  redundancy  to  the  digital  data  in  a  selective 
manner.  The  methods  of  coding  which  are  considered  include  error 
correcting  codes,  energy  coding  and  the  selection  of  waveforms 
for  transmission  over  the  communication  channel.  The  use  of 
error-correcting  codes  provides  the  nonlinear  modulation  tech¬ 
nique  with  memory  which  is  important  for  efficient  utilization 
of  bandwidth. 
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BACKGROUND  ON  MODULATION  THEORY 

In  this  section  we  will  discuss  the  theoretical  back¬ 
ground  which  provides  some  of  the  basic  motivation  for  under¬ 
taking  this  research  program.  This  background  includes  the 
fundamental  ideas  of  rate  distortion  theory  and  an  explanation  of 
the  gap  which  exists  between  the  performance  of  existing  mod¬ 
ulation  techniques  such  as  AM,  FM,  and  PCM  and  what  can  theo¬ 
retically  be  achieved  by  more  advanced  techniques. 

2 . 1  Rate  Distortion  Theory 

The  elements  of  rate  distortion  theory  are  to  be  found 
in  Shannon's  original  work  [l]  and  in  more  detail  in  his  later 
work  [2].  This  theory  provides  the  means  for  calculating  the 
best  obtainable  performance  for  the  communication  channel 
which  is  under  consideration.  In  the  following  paragraphs 
we  will  present  the  elements  of  this  theory  and  how  it  applies 
to  our  specific  problem. 

Consider  the  diagram  of  the  essentials  of  a  communica¬ 
tion  system  shown  in  Fig.  2.1.  The  information  process  x(t) 
(0<t<T)  is  encoded,  transmitted  over  the  noisy  channel  and 
decoded  to  yield  the  estimate  x(t).  The  distortion  measure 
which  is  of  interest  to  us  is  the  mean  square  error  and  is 
given  by 

T 

D  =  lim  E (~  J  (x ( t)  -  x(t))2dt) 

T-»» 
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If  we  are  willing  to  tolerate  a  distortion  D  in  the  trans¬ 
mission  of  a  process  x{t)  the  minimum  amount  of  channel  capacity 
required  for  such  transmission  can  be  determined  from  the  rate 
distortion  function  of  the  x(t)  process,  which  we  denote  by 
R{D)  . 

Before  mathematically  defining  the  rate  distortion  function 
for  a  process  it  is  worthwhile  to  discuss  its  properties  and 
how  it  is  used.  In  Fig.  2.2  below  we  have  what  might  be  called 
a  typical  R(D)  function.  If  we  select  the  value  of  distortion 
D  along  the  distortion  axis  the  corresponding  value  of  R  is  the 
minimum  rate  at  which  the  information  source  under  consideration 
can  be  transmitted  and  still  achieve  a  distortion  D.  That  is. 


Fig.  2.2  Typical  Rate  Distortion  Function 
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transmission  of  the  source  at  any  rate  less  than  the  amount  R 
for  a  given  D  will  result  in  a  distortion  greater  than  D  regard¬ 
less  of  the  means  used  for  transmission.  Conversely,  if  we  have 
available  an  amount  of  channel  capacity,  C,  which  is  greater  than 
the  R  for  a  given  D  then  we  know  from  rate  distortion  theory  that 
there  exists  a  means  of  encoding  and  transmitting  the  informa¬ 
tion  source  which  can  achieve  a  distortion  equal  to  D. 

In  summary  rate  distortion  theory  is  a  theory  which  in¬ 
dicates  what  can  and  cannot  be  achieved  in  performance  in  trans¬ 
mitting  a  given  source.  The  theory  does  not  specify  the  means 
for  achieving  obtainable  performance; however,  by  telling  us  what 
can  be  achieved  in  an  absolute  sense  enables  us  to  gauge  whether 
there  is  enough  of  a  reason  to  search  for  new  techniques  for  the 
transmission  of  data. 

If  we  are  willing  to  tolerate  a  distortion  D  in  the  trans¬ 
mission  of  a  process  x(t)  the  rate  distortion  function  for  the 
minimum  amount  of  channel  capacity  which  is  necessary  to  achieve 
this  can  be  related  to 

Rt(D)  =  inf  ^  I(x(t),  x  ( t) ) 

A 

where  I(x(t),  x(t))  is  the  mutual  information  between  x  (t) 
and  x  (t)  0  <  t  <  T  and  the  inf  is  taken  over  all  communication 
links  which  will  provide  a  distortion  D.  The  rate  distortion 
function  is  defined  as 

R{D)  =  inf  R,r(D) 

T 

It  is  immediate  from  the  definition  of  the  rate  distor¬ 
tion  function  that  if  we  wish  to  transmit  the  process  x(t) 
with  at  most  a  distortion  D  we  require  a  channel  capacity  of 


C  >  R(D).  More  importantly,  it  was  shown  by  Shannon  that 
the  converse  statement  is  also  true.  That  is,  if  one  has 
available  a  capacity  C  >  R(D)  it  is  then  possible  to  transmit 
with  a  distortion  less  than  D. 

In  addition  if  we  have  available  a  channel  capacity  C 

for  transmission  the  minimum  achievable  distortion  D  .  is 

min 

obtained  from  the  relationship 


R(D  .  )  = 
min 


or 


D  . 
min 


R  1(C)  . 


Of  particular  interest  in  this  report  is  the  case  where 
the  channel  is  bandlimited  to  a  bandwidth  W  and  has  an  addi¬ 
tive  white  Gaussian  noise  with  spectral  density  Nq/2.  if 
the  available  average  transmitting  power  is  P,  the  capacity 
of  this  channel  is  given  by  the  well  known  formula 


C  =  W  log  (1  +  P/m  )  (1) 

o 

If  our  data  source  has  a  bandwidth  of  B  and  an  average 
power  S,  Shannon  [l]  proved  that  the  rate  distortion  function 
is  bounded  by 


B  log  Q/D  <  R (D)  <  B  log  S/D  (2) 

where  D  is  the  mean  square  error  and  Q  is  the  entropy  power 
of  the  source.  Entropy  power  is  defined  as  the  power  of  a 


.O 
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Gaussian  source  which  has  the  same  ertropy  as  the  message 
source,  i.e.. 


t 


Q  = 


2H 
e _ 

2ne 


(3) 


H  being  the  entropy  per  unit  time  generated  by  the  source. 

If  we  let  D  .  denote  the  minimum  distortion  and 
min 


i 

i 

t 


! 


t 

I 

! 

j 


P 


max 


=  S/D 


(4) 


be  the  maximum  output  signal-to-noise  ratio,  and  p  =  W/B  = 
bandwidth  expans ion  factor,  we  can  then  obtain  from  (1)  and 
(2)  that 


(1 


1 

+  T 


e  nb 


■)  3  <  p. 


max 


<  <!> 


(i  + 


(5) 


The  factor  S/Q  is  always  greater  than  or  equal  to  unity  since 
entropy  power  is  always  less  than  or  equal  to  the  actual 
power,  with  the  equality  holding  when  the  source  is  Gaussian. 
The  factor  S/Q  is  in  a  sense  a  measure  of  the  non-Gauss ianity 
of  the  source. 


For  a  Gaussian  source,  source  power  is  equal  to  entropy 
power  and  the  upper  and  lower  bounds  on  Pmax  are  equal  giving 


Kmax 


(1  +  —  — £-)  ^ 
v  MB 
o 


(6) 


5> 

* 


9* 


2-6 


T 


& 

I 

& 

►S” 


For  the  infinite  bandwidth  channel  we  have  from  (6)  letting 
{3  00 ,  that  the  maximum  achievable  signal-to-ncise  ratio  is  then 


P/N  B 
o 

P  =  e 
max 


(7) 


Through  this  report  we  will  be  dealing  with  informa¬ 
tion  sources  which  are  assumed  to  have  a  uniform  amplitude 
distribution.^"  In  this  case  the  upper  and  lower  bounds  on 

p  differ  by  only  1.5  dB.  In  this  report,  where  no  con- 
Kmax  2  c 

fusion  will  arise,  we  will  refer  to  the  p  function  as  the 

max 

R (D)  function  indicating  that  it  is  the  rate  distortion 
bound  on  achievable  performance. 

For  a  more  detailed  discussion  on  the  connection  be¬ 
tween  analog  modulation  and  rate  distortion  theory  see  the 
paper  by  Goblick  [3]. 

2.2  Performance  of  Modulation  Techniques  and  Comparison 
with  Theoretical  Bounds 

In  order  to  be  able  to  fairly  judge  the  performance  of 
the  MSM  (Mulci-Stream  Modulation) ,  discussed  in  Section  3  of 
this  report  we  must  compare  MSM  performance  with  the  modula¬ 
tion  techniques  which  are  currently  in  use  (FM,  PCM  and  AM) 
and  also  compare  MSM  with  theoretical  bounds.  A  brief  de¬ 
scription  and  performance  FM,  PCM,  and  AM  are  given  below. 

Throughout  this  report  the  following  definition  will  be 
\,ised  for  input  and  output  signal-to- noise  ratios: 


fK  =  Input  (SNR)  =  P/NqB  (8) 


This  is  an  idealized  assumption  which  enables  the  theoretical 
calculations  to  be  performed. 
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where  P  is  the  average  power  which  is  to  he  transmitted,  Nq/2  is 
the  noise  power  density  of  the  channel  noise  and  B  is  the  band¬ 
width  of  the  information  process  which  is  to  be  transmitted, 

o  =  Output  (SNR)  =  S/D  (9) 

ro 

where  S  is  the  average  power  of  the  information  process  and 
D  is  the  mean  square  error  made  in  reconstruction  of  the  in¬ 
formation  process  by  the  receiver. 

2.2.1  Frequency  Modulation 

Frequency  modulation  is  historically  the  first  practical 
modulation  method  devised  which  uses  bandwidth  instead  of  power 
for  obtaining  increased  noise  immunity.  Figure  2.3  shows  the 
basic  elements  of  an  FM  system.  The  operation  of  the  modulator 
is  clear  from  the  figure.  In  the  demodulator  the  limiter  is  used 
for  the  suppression  of  noise  peaks  and  the  discriminator  puts  out 
the  derivative  of  the  phase  of  its  input. 

The  performance  curves  for  this  FM  system  are  given  in  Fig. 
2.4.  In  calculating  the  performance  we  have  assumed  that  the 
spectrum  of  the  modulating  signal  is  flat  over  its  bandwidth  and 
that  the  information  is  being  transmitted  over  a  band  limited 
additive  Gaussian  noise  channel.  The  factor  p  is  the  bandwidth 
expansion  factor.  Since  the  bandwidth  of  the  frequency  modulated 
signal  has  no  finite  limit  its  output  bandwidth  is  taken  to  be  that 
frequency  band,  centered  about  the  carrier  frequency,  which  con¬ 
tains  99  percent  of  the  power  of  the  output  of  the  modulator. 

In  Fig.  2.4  can  also  be  seen  the  difference  in  p erformance 
between  the  theoretically  obtainable  performance  and  FM  perfor¬ 
mance  for  a  variety  of  bandwidth  expansions.  Note  the  large  gap 
between  R(D)  and  the  FM  curves. 


>  ! 
* 


The  expression  we  have  used  for  input  versus  output  SNR 
is  based  on  the  work  of  Rice  [4]  and  Bello  [5] and  is  given  by 

1 


po  = 


2pi, 


!  r..f  1/12  +  Pi/18  n-3  -1 

L+  72  f 1  e  ^  np  .  +  12  P  pi 

’  i 


A  derivation  of  this  expression  is  given  in  Bussgang  and  Gish  [6], 
2.2.2  Pulse  Code  Modulation 

PCM  was  the  first  digital  modulation  method  which  made  ef¬ 
ficient  use  of  bandwidth  in  the  transmission  of  analog  data.  The 
basic  elements  of  this  system  are  shown  in  Fig.  2.5.  The  source 
waveform  x(t),  of  bandwidth  B,  is  sampled  at  the  Nyquist  rate 
of  R  =  2B  samples/sec.  Each  of  the  samples  is  quantized  into 
N  bits.  The  bits  are  then  transmitted  over  the  channel,  detected 
at  the  receiver,  and  then  converted  back  into  sample  values  by 
the  A/D  converter.  The  analog  waveform  is  then  recovered  by  feed¬ 
ing  the  sample  values  into  a  low  pass  filter.  Performance  of 
PCM  was  first  analyzed  in  a  paper  by  Oliver,  Pierce  and  Shannon 
[7]  and  more  recently  in  a  paper  by  Viterbi  [8].  It  should  be 
noted  that  two  limiting  properties  of-  PCM  systems  ares 

(1)  The  system  has  no  memory,  i.e.,  each  input  sample  is 
processed  independently. 

(2)  No  cognizance  is  taken  of  the  fact  that  certain  parts 
of  the  message  are  more  important  than  others. 

The  mean  square  error  made  in  transmitting  a  signal  by  PCM 
consists  of  two  terms 

D  =  D  +  D 
q  c 

where  D  is  the  mean  square  error  made  in  quantizing  the  input 
sample  and  Dc  is  the  mean  square  distortion  caused  by  effects 
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of  the  channel.  If  we  take  the  amplitude  of  the  input  process 
to  be  uniformly  distributed  over  the  interval  [-A,  +  A]  the 
quantization  error  is  given  by 


After  the  process  of  A/D  conversion,  the  input  sample  has  the 
quantized  representation  which  we  denote  by 

N 

x  =  A  £  a .  2  1 
«  i=l  1 

where  the  a^  take  on  the  values  +  1.  If  a  channel  is  memoryless, 
as  is  the  case  with  the  additive  Gaussian  noise  channel,  bit  er¬ 
rors  in  the  transmission  of  the  a^  occur  independently.  If  we 
let  P  denote  the  probability  of  a  bit  being  in  error  we  have 

N 

2  -i+1  24  N 

D  =  A^  P  JJ  4  1+1  =  •  P  f  (1- (1/4)  ; 

c  i=i  3 

The  output  SNR  is  given  by 

PQ  =  S/D 

-  »/  <Dq+  De) 

_  _ 1 _ 

-N  -N 

4  +  4P(1  -  4  ) 

The  dependence  of  p  on  the  input  SNR  p  .  is  a  function 

o  i 

of  the  means  of  transmission  of  the  binary  data  and  the  de¬ 
pendence  of  the  error  probability  of  the  binary  transmission 
scheme  on  p^.  The  bandwidth  expansion  for  PCM  also  depends  on 
the  means  used  for  binary  transmission.  We  can  however  write 
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where  N  is  the  number  of  bits  used  in  quantization  and  k  is 
the  number  of  multiples  of  the  bandwidth  of  the  information 
process  occupied  by  the  binary  transmission.  If  the  binary 
information  is  transmitted  by  single  sideband  pulse  then  k  =  1 

and  SPCM  =  N- 

In  Fig.  2.6  which  follows  we  have  plotted  PCM  performance 
for  N  =  8  and  k  =  1,  i.e.,  a  bandwidth  expansion  of  eight.  The 
binary  data  transmission  was  taken  to  be  coherent.  We  have  also 
presented  on  this  curve  the  FM  performance  and  the  rate  distor¬ 
tion  bound.  The  channel  was  taken  to  be  additive  Gaussian 
noise.  This  figure  is  particularly  important  in  that  it  was 
for  0=8  for  which  the  experimental  breadboard  was  designed. 

The  breadboard,  in  addition  to  having  the  MSM  mode  also  has  a 
PCM  capability  for  0=8.  The  curve  SS-AM  is  for  single  side-band  AM. 

2.2.3  Pulse  Amplitude  Modulation/PCM 

The  term  Pulse  Code  Modulation,  usually  refers  to  those 
transmission  systems  as  shown  in  Fig.  2.3  where  the  data  is 
carried  by  a  binary  stream.  In  general,  the  digitized  data  can 
be  transmitted  by  pulses  which  carry  several  bits  of  information. 
One  such  method  of  transmission  is  where  the  binary  information 
is  encoded  into  the  amplitude  of  the  transmitted  pulse.  Such  a 
system  we  refer  to  as  Pulse  Amplitude  Modulation/PCM.  The  block 
diagram  in  Fig. 2. 7  shows  the  structure  of  a  PAM/PCM  system,  the 
digital  logic  being  required  to  use  the  bits  to  generate  pulses 
of  the  required  amplitude. 

A  basic  analysis  of  PAM/PCM  systems  was  given  by  Gish  and 
Buss gang  in  RADC  technical  report  [6]  . 
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PCM  System  for  the  Transmission  of  Analog  Data 


Referring  to  Fig.  2.7  we  have  a  sequence  of  input  samples* 

We  assume  them  to  oe  independent,  uniformly  distributed  from 
(-1,  +1) ,  and  quantized  into  J  =  log  N  bits  ,  where  N  is  the 
number  of  levels.  The  samples  occur  every  Tg  seconds.  The  M 
bits  are  grouped  into  P  blocks  of  j/p  bits.  Each  of  these  blocks 
is  interpreted  as  a  binary  number  whose  value  is  used  to  mod¬ 
ulate  the  amplitude  of  the  pulse  which  is  transmitted  over  the 
channel.  Each  of  these  pulses  is  transmitted  in  Tc  seconds 
which  gives 

(3  =  bandwidth  expansion 

-  T  /T 
s  c 


The  receiver  detects  the  pulse  amplitudes  and  converts 
each  received  pulse  into  R/P  bits.  When  R  bits  are  accumulated 
the  D/A  converter  puts  out  an  analog  value. 


More  specifically,  consider  the  case  where  the  input  sample 
is  quantized  into  N  levels  which  implies  that  we  have  P  pulses/ sample 
being  transmitted,  each  containing  log  N/P  information  encoded 
in  its  amplitude.  The  total  error  that  the  system  makes  in 
transmitting  this  analog  value  consists  of  two  terms.  The  first 
term  is  due  to  the  quantization  error  and  the  second  is  caused 
by  channel  noise.  The  mean  square  quantization  error  is  given 
by 


In  order  to  compute  the  effect  of  the  channel  noise  on  the  analog 
error  we  first  assume  that  the  unmodulated  pulse  has  spectrum 


S(f) 


|f|  <  wc 

otherwise 
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where  Wc  =  l/2Tc,  being  the  channel  bandwidth.  Each  pulse  is 
modulated  by  one  of  M  =  N  1/P  values  which  we  take  as  +k,  +3k,  ... 
With  this  system  model,  the  average  transmitted  power  is  given 
by 

00 

Pg  -  E(^-  J  (as (t) )2  dt) 

C  — 89 

s(t)  being  the  transmitted  pulse  and  "a"  the  modulation  E  denotes 
the  taking  of  the  expectation.  This  gives 

2wc  2 
Ps  -  iT2  ) 
c 

=  E(a2) 


=  k 


2  M2-! 
(  3 


) 


Now,  in  order  to  relate  the  channel  noise  we  must  compute 
the  quantities 


P(i/j) 


Probability  that  the  i^1  level  was  received 
given  that  the  j'*'"  level  was  transmitted 

i,  j  =  1,  .  .  .  M 


The  calculation  of  the  above  transition  probabilities  is 
relatively  straightforward.  If  the  noise  power  density  is  Nq/2 
then 


P  (1/j )  =  Pr[n>  2k  (2  |  1  -  j  |  -  1]  j  /  1 
where  n  is  a  Gaussian  random  variable  with  variance 


2 

o 

n 
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Similarly, 


P(M/j)  =  Pr[n>k(2 |  M-j  |  -  1]  j  £  M 


and 

P  ( i/  j )  =  Pr[ri>k(2ji-j  j  -  1)  ]-Pr[n>k  (2  j  i-j  |  +  1)  ]  i^l,M 


The  above  probabilities  are  readily  expressible  in  terms  of 
error  functions. 


In  order  to  use  the  above  expression  in  the  calculation  of 
error  performance  we  must  condition  our  calculations  as  to  which 
of  the  (3  pulses  contained  the  error,  since  the  actual  pulse 
location  will  affect  the  analog  error.  To  see  this,  consider 
the  binary  expansion  of  the  quantized  version  of  the  input,  i.e., 

J 

x  =  £  a. 2  1 


where  a^  =  +1  and  J  =  log  N.  In  the  AM/PCM  system,  which  we  are 
describing,  it  is  these  coefficients  which  we  are  transmitting. 
More  specifically,  the  coefficients  (a^)  are  formed  into  P  groups 
with  each  group  determining  the  amplitude  of  one  of  the  P  pulses 
representing  the  sample.  That  is,  if  coefficients  a_.,...a^+^  are 
in  the  k^  group,  the  number 


i=l 


a.  .  ,2 
3+1-1 


-i 


til 

determines  the  j-  pulse  amplitude.  An  error  occurring  in  a 
pulse  which  represents  the  most  significant  bits  will  cause  a 
larger  analog  error  than  if  an  error  occurs  in  a  pulse  which  repre¬ 
sents  less  significant  bits.  Keeping  this  in  mind,  we  are  now  in 
position  to  evaluate  the  effect  of  the  channel  on  the  analog  error. 


22 
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We  have 


D  =  E  E(e  |k  pulse  transmitted)  PR(k  pulse) 

C  k=l  C 

P  2  th 

=  1/P  E  E (e  jk  pulse  transmitted) 
k=l  C 

where  e  denotes  the  error  in  transmission  due  to  the  channel, 
c 

If  we  let  l  =  R/P  (assumed  to  be  an  integer)  it  is  not  difficult 

til 

to  show  that  an  error  in  the  k  pulse  must  be  weighted  by  a 
fact  2  ^  ^  Taking  this  factor  into  account,  we  arrive  at 


1  i  Q 

Dc  =  —  —  (1-(%)P)  E(ec  | first  pulse  transmitted) 


with 


first  pulse  transmitted) 


1 

M 


MM 

E  E  (1,-1.)  P(i|j) 
i=l  j=l  1  J 


where 


M  =  2 


and 

h  -  s  i21-1'  -  i- 

The  total  mean  square  error  is 


D  =  D  +  D 

q  c 

It  is  this  calculation  which  is  used  in  the  plotting  of  the  curves 
given  in  Figs.  2.8,  2.9,  and  2.10,  which  are  for  expansion  ratios 
of  2,  3,  and  4,  respectively. 

These  curves  show  that  PCM  with  a  well-selected  number  of 
quantization  levels  outperforms  straight  SSB-AM  over  a  limited 
region  of  signal- to-noise  ratio.  As  any  digital  system,  PAM/PCM 
does  not  improve  with  SNR  beyond  a  certain  point  because  of  the 
quantization  noise.  Below  an  adequate  channel  SNR,  PAM/PCM 
becomes  comparable  to  SSB-AM  in  performance. 
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An  alternate  method  of  communication  is  a  multiphase/PCM 
system  in  which  the  quantization  levels  are  transmitted  by  one 
of  several  phases.  The  binary  case,  i.e.,  when  only  one  of 
two  phases  are  used  will  of  course  give  the  same  performance  as 
a  PAM/ PCM  system.  For  higher  order  phase  systems  the  same  for¬ 
mulas  will  apply  as  in  the  PAM  case  except  that  the  approxpriate 
values  of  P(i/j)  be  used.  It  should  be  noted  that  when  phase 
modulation  is  used  to  transmit  quantization  levels  rather  than 
amplitude  modulation  an  additional  bandwidth  expansion  factor 
of  two  is  required.  This  is  due  to  the  fact  than  an  AM  pulse 
can  be  transmitted  single  side  band,  while  a  constant  amplitude 
phase  modulated  pulse  will  have  double  side  bands. 

2.2.4  Weighted  PCM 

In  a  weighted  PCM  transmission  system  the  total  available 
energy  is  distributed  among  the  bits  to  be  transmitted  in  a 
way  as  to  reduce  the  distortion  in  the  transmitted  analog  wave¬ 
form.  The  notion  of  varying  energy  assignments  was  first  analyzed 
by  Bedrosian  [ 9] .  This  procedure  of  allocation  of  energy  can  be 
viewed  as  an  elementary  form  of  coding  without  memory.  An  ex¬ 
ample  illustrating  this  principle  is  given  below. 

Curve  (1)  in  Fig.  2.11  shows  the  performance  of  a  system 
in  which  each  sample  is  quantized  into  six  bits  and  the  energy 
assignment  to  each  bit  is  optimized  to  minimize  the  output  SNR. 

The  optimum  energy  assignement  will  be  a  function  of  the  input 
SNR.  Curve  (3)  gives  the  performance  of  a  conventional  binary 
PCM  system  with  six  bit  quantization  and  the  energy  equally 
assigned  to  all  the  bits.  Clearly  the  optimized  system  has 
uniformly  greater  performance  than  the  conventional  system.  In 
particular  we  see  that  at  an  input  SNR  of  15  dB  there  is  an  8.5  dB 
gap.  This  represents  a  substantial  difference  in  performance. 

The  bit  energy  assignments  can  be  achieved  by  variation  of  the  bit 
amplitudes. 
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The  system  whose  performance  is  given  by  curve  (2)  was 
permitted  no  variation  in  pulse  amplitude  and  energy  could 
be  varied  only  by  repeating  bits  for  the  channel.  With  these 
constraints  we  repeated  the  most  significant  bit  three  times, 
the  second  and  third  most  significant  bits  twice,  and  the  last 
three  bits  were  transmitted  uncoded.  This  simple  scheme  which 
we  are  using  to  illustrate  energy  coding  has  a  bandwidth  ex¬ 
pansion  of  10  and  for 

(S/N)  =  15  dB 

(S/N)  =  19.5  dB 

o 

The  curve  showo  an  improvement  of  6  dB  over  binary  PCM 
with  an  expansion  of  6  which  is  the  optimum  PCM  system  for  the 
range  of  interest.  This  difference  will  only  increase  in  favor 
of  weighted  PCM  if  we  compare  to  PCM  systems  with  other  bandwidth 
expansion,  e.g.,  bandwidth  e2q>ansion  also  of  10. 
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SECTION  III 


MULTISTREAM  MODULATION 


3.1  General  Description  of  MSM 

Multistream  Modulation  is  a  digital  method  df  analog 
modulation.  In  this  method  of  modulation  the  analog  signal 
is  first  sampled  and  quantized  into  a  stream  binary  digits 
each  of  different  significance.  Digital  coding  is  then  selec¬ 
tively  applied  to  the  digitized  signal.  T^e  coding  is  applied 
so  that  the  most  important  parts  of  the  signal  receive  the 
most  protection. 

A  block  diagram  of  a  MSM  system  i£  given  in  Fig.  3.1. 

We  have  the  analog  source  being  converted  into  streams  of  bits 
at  the  Nyquist  rate  of  the  source.  The  bit  streams  then  enter 
a  digital  coding  network  which  applies  redundancy  in  a  pre¬ 
scribed  manner  with  the  greater  protection  going  to  the  more 
significant  bits.  The  assignment  of  more  protection  to  the 
more  significant  bits  may  mean  a  corresponding  reduction  in 
protection  for  the  least  significant  bits.  In  addition,  the 
assignment  of  redundancies  by  the  coding  network  must  take 
into  account  how  the  encoded  data  is  assigned  to  channel  sym¬ 
bols,  since  the  assignment  of  bits  to  symbols  can  in  itself 
provide  a  certain  degree  of  coding.  These  ideas  will  become 

clearer  as  specific  examples  of  MSM  are  considered. 


It  should  be  noted  that  by  regarding  the  output  of  the 
A/D  as  streams  of  bits  of  different  significance  enables  one 
to  have  a  coding  network  which  make  efficient  use  of  the 
time  history  of  the  process. 


The  concept  of  applying  more  protection  to  the  more  sig¬ 
nificant  bits  has  appeared  in  other  works.  These  works  have 
been  concerned  with  particular  aspects  of  this  concept  and  not 
with  the  development  of  a  new  approach  to  modulation.  In  the 
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work  of  Bedrosian  [9]  different  amounts  of  energy  were  assigned 
to  different  bits.  This  scheme  is  essentially  a  zero  memory 
coding  technique.  Masnick  &  Wolf[lCfl  considered  the  general 
properties  of  codes  which  gave  unequal  error  protection.  Apple 
&  Wintz [11]  have  considered  the  application  of  codes  to  bits  of 
different  significance,  however  no  attempt  was  made  to  constrain 
bandwidth  and  relate  the  coding  to  analog  modulation. 

3.2  MSM  with  Individual  Stream  Coding 

MSM  with  coding  applied  to  individual  streams  is  an  im¬ 
portant  special  case  of  the  coding  network  shown  in  Fig.  3.1. 

The  reason  for  this  being  that  most  known  codes  are  designed 
to  operate  on  individual  streams  rather  than  on  vectors  (i.e., 
multiple  streams) .  The  structure  of  MSM  with  individual  stream 
coding  is  shown  in  Fig.  3.2. 

In  the  remainder  of  this  report  we  will  be  concerned  solely 
with  this  structure.  It  is  a  special  case  of  this  structure 
which  we  have  implemented.  In  the  following  paragraphs  we 
will  examine  what  the  important  parameters  of  the  system  are 
and  how  the  performance  of  such  a  system  is  designed  and  eval¬ 
uated. 

The  output  of  our  analog  source  is  a  message  x(t)  of 
bandwidth  B  which  we  wish  to  transmit  over  a  channel  of  band¬ 
width  W  =  0B.  The  available  average  power  for  the  transmis¬ 
sion  of  the  signal  is  P. 

The  message  x(t)  is  sampled  at  the  Nyquist  rate  R  =  2B 
samples/sec.  The  samples  are  converted  into  N-bits  by  the 
A/D  converter,  and  we  can  represent  the  output  of  the  A/D  in 
the  form: 
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The  data  from  the  encoders  goes  to  the  channel  signal 
generator  which  must  put  this  data  out  on  the  channel, subject 
to  the  average  power  and  bandwidth  constraints.  The  nature 
of  the  signals  which  the  signal  generator  can  put  out  has  a 
strong  bearing  on  the  nature  of  the  system.  In  general  terms 
the  signal  generator  puts  out  a  waveform  which  we  will  denote 
by  p(t,a)  where  the  parameter  a  depends  on  the  bit  sequence 
and  is  used  to  modulate  the  waveform  without  changing  its 
bandwidth*  For  example,  the  factor  a  can  be  indicative  of 
amplitude  modulation  or  phase  shift  of  the  basic  waveform 
put  out  by  the  signal  generator. 

The  waveforms  p(t,a)  have  a  bandwidth  f3B  and  a  duration 
Tc*.  With  Tc  being  pulse  duration  the  number  of  pulses  which 
can  be  put  out  by  the  channel  signal  is  given  by 

Y  =  T  /T  (10) 

c  s 

that  is,  for  each  input  sample  which  enters  the  MSM  y  samples 
are  sent  by  the  signal  generator.  This  is  a  direct  consequence 
of  the  bandwidth  limitation  and  the  nature  of  the  waveform  used 
by  the  signal  generator.  The  output  signal  which  is  trans¬ 
mitted  by  the  MSM  operating  over  a  period  of  time  is  given  as 

y (t)  =  E  p(t  -  nTc,  c^)  (11) 

n 


* 

Note  that  by  time  duration  of  the  pulse  is  actually  meant 
the  minimum  time  separation  between  waveforms  so  that  there 
is  no  intersymbol  interference. 
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Fig.  3.3.  Representation  of  Bit  Streams  from  A/D. 

where  the  i  row  of  the  matrix  represents  the  1  most  sig- 

til 

nificant  bit  from  k  samples  and  the  j  column  represents  the 

til 

N  bits  from  the  A/D  for  the  quantization  of  the  j  sample. 

Following  the  A/D  conversion  the  bits  from  each  of  the 

streams  enter  the  appropriate  coding  device  for  that  stream. 

til 

The  encoder  for  the  i  stream  will  require  k^  information 

bits  as  input  and  put  out  a  code  word  of  N.  bits.  The  rate 

th  ^ 

of  the  i  code  is  r.  =  k./N.. 

1  11 

Since  the  k^  can  in  general  be  arbitrary,  a  certain 
amount  of  buffering  not  shown  in  Fig.  3.2  will  have  to  take 
place  in  order  to  implement  the  encoding. 

Since  samples  are  entering  the  A/D  at  a  rate  of  2B 
samples/sec. ,  and  since  each  sample  is  quantized  into  N  bits, 
we  have  that  in  the  sampling  time  interval  Tg  =  1/2B 


M  =  E  r. 
i=l  1 


bits  being  generated  at  the  output  of  the  coders. This  corresponds 
to  an  average  data  rate  of 


R  =  M/Ts  bits/s 
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The  data  from  the  encoders  goes  to  the  channel  signal 
generator  which  must  put  this  data  out  on  the  channel, subject 
to  the  average  power  and  bandwidth  constraints.  The  nature 
of  the  signals  which  the  signal  generator  can  put  out  has  a 
strong  bearing  on  the  nature  of  the  system.  In  general  terms 
the  signal  generator  puts  out  a  waveform  which  we  will  denote 
by  p(t,a)  where  the  parameter  a  depends  on  the  bit  sequence 
and  is  used  to  modulate  the  waveform  without  changing  its 
bandwidth 4  For  example,  the  factor  a  can  be  indicative  of 
amplitude  modulation  or  phase  shift  of  the  basic  waveform 
put  out  by  the  signal  generator. 

The  waveforms  p(t,a)  have  a  bandwidth  (3B  and  a  duration 

T  *.  With  T  being  pulse  duration  the  number  of  pulses  which 
c  c 

can  be  put  out  by  the  channel  signal  is  given  by 

Y  =  T/T  (10) 

c  s 

that  is,  for  each  input  sample  which  enters  the  MSM  y  samples 
are  sent  by  the  signal  generator.  This  is  a  direct  consequence 
of  the  bandwidth  limitation  and  the  nature  of  the  waveform  used 
by  the  signal  generator.  The  output  signal  which  is  trans¬ 
mitted  by  the  MSM  operating  over  a  period  of  time  is  given  as 

y (t)  =  Z  p(t  -  nTc,  c^)  (11) 

n 


Note  that  by  time  duration  of  the  pulse  is  actually  meant 
the  minimum  time  separation  between  waveforms  so  that  there 
is  no  intersymbol  interference. 
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An  important  special  case  for  MSM  is  when  the  waveform 
generator  puts  out  signals  of  the  form  of  the  well  known  sine 
function 


p(t,a)  =  a 


sin  (2n8Bt) 
2TTf3Bt 


(12) 


for  which 


T  = 


1 

2|3B 


(13) 


The  spectrum  of  the  sine  function  is  that  over  a  bandwidth 
BB.  The  output  waveform  is  then 


y(t)  =  J  an 


sin  2TT0B(t  -  nT  ) 
2tt[3B  (t  -  nTp) 


(14) 


where  an  is  an  amplitude  derived  from  the  encoded  bits.  It 
is  this  model  for  the  channel  signal  g  .erator  with  the  in¬ 
corporation  of  bits  into  signal  amplitudes,  on  which  the 
designs  for  the  experimental  breadboard  were  made. 

3 . 3  Design  and  Performance  of  MSM 

3.3.1  Systematization  of  Design 

In  the  previous  subsection  the  various  factors  entering 
into  the  design  of  a  MSM  system  were  discussed.  At  present 
there  exists  no  satisfactory  systematic  approach  to  the  de¬ 
sign  for  a  MSM.  The  most  effective  approach  is  one  based 
on  the  intuition  of  the  designer  coupled  with  a  trial  and 
error  procedure. 
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There  are  several  reasons  for  the  difficulty  in  finding 
a  systematic  approach  to  MSM  design,  the  first  of  which  is 
the  very  large  number  of  parameters  involved.  These  param- ' 
eters  include  the  number  of  bits  N  in  the  initial  A/D  conver¬ 
sion,  the  amount  of  redundancy  which  should  be  assigned  to 
each  stream  and  the  possible  assignment  of  encoded  bits  to 
channel  waveforms.  Secondly,  information  needed  for  the 
calculation  for  performance  is  not  available.  That  is,  the 
bit  error  probability  for  codes  is  by  and  large  unavailable, 
and  in  those  cases  where  they  do  exist,  they  exist  mainly  for 
the  binary  symmetric  channel. 

Thirdly,  the  criteria  for  what  makes  one  modulation  sys¬ 
tem  preferable  to  another  will  vary  from  user  to  user,  A  modulation 
system  must  work  over  a  range  of  SNR’s  and  it  is  the  shape  of 

the  p  vs  p .  curve  which  is  important  to  a  user  and  not  the 

o  1 

value  of  the  curve  at  a  specific  point.  This  is  illustrated 
by  Fig.  3.4  shown  below.  The  preference  may  be  for  charac¬ 
teristic  (1)  if  the  region  of  operation  is  primarily  high  pi 
or  characteristic  (2)  if  one  is  willing  to  trade  performance 
at  the  high  end  for  a  shift  in  the  threshold  region. 

3.3.2  Calculation  Details 

Before  getting  into  specific  system  designs  with  their 
specific  performance  calculation,  it  will  be  worthwhile  to  exa¬ 
mine  in  more  general  terms  what  is  involved  in  a  calculation. 

As  in  the  calculation  of  PCM  performance  we  can  decompose 
the  error  into  two  independent  terms 


Vj*v.wy>u.g*'*. 


D  +  D 
q  c 


(15) 


D  = 


where  is  the  mean  square  error  due  to  quantization  and 
is  the  mean  square  error  due  to  the  effects  of  the  channel. 
When  the  quantization  by  the  A/D  is  into  N  bits 


D 

q 


(16) 


where  we  have  assumed,  as  before,  that  the  input  samples  are 
uniformly  distributed  over  the  interval  [-A,+A], 

Let  us  represent  a  quantized  sample  as 

N 

x  =  A  E  a.2-1  (17) 

q  1 


and 


x 

q 


i  =1 


as  the  value  recovered  by  demodulating  the  MSM. 
We  then  have 


D 

c 


=  E 


2 


N 

E 

i=l 


N 

E 

i=l 


E(a.-d.)  (a.-a.)2_(l+:i) 
11  3  3 


(18) 
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It  is  important  to  note  that  the  bit  errors  in  MSM  will  not, 
in  general,  all  occur  independently  and  the  evaluation  of  (18) 
will  require  knowledge  of  the  joint  probability  density  of  errors. 
This  nonindependence  of  errors  arises  from  the  fact  that  the  en¬ 
coding  process  has  given  us  a  greater  number  of  bits  than  we 
originally  had  and  in  order  to  meet  the  bandwidth  constraint  sev¬ 
eral  bits  will  have  to  be  carried  by  a  single  transmitted  waveform. 

The  basic  problem  in  evaluating  performance  is  in  the  evalu- 
tion  of  expression  (18) .  With  expression  (18)  calculated  it  then 

becomes  possible  to  calculate  a  curve  of  pQ  versus  p^. 

3.4  Specific  Designs 

In  choosing  a  design  for  illustrating  the  principles  of 
MSM  the  first  consideration  was  that  it  should  be  designed  to 
operate  for  a  bandwidth  expansion  which  was  commonly  used  for 
PCM  and  also  for  FM.  The  primary  design  was  made  for  P  =  8 
since  8  bit  PCM  is  fairly  common  and  this  is  also  a  good  band¬ 
width  expansion  for  FM.  A  second  design  was  made  for  P  =4. 

A  fourfold  bandwidth  expansion  is  not  enough  for  a  meaningful 
PCM  system  and  FM  offers  the  only  viable  comparison  for  P  =  4. 

3.4.1  Design  for  P  =  8 

It  should  be  realized  that  the  design  which  is  discussed 
below  is  the  outcome  of  a  trial  and  error  procedure  in  which 
there  were  several  false  starts  and  a  gradual  evolution  of  the  accepted  . 
The  basic  elements  in  the  design  of  the  modulator  that  was  built  are 
shown  in  Fig.  3.5. 

We  have,  as  shown  in  the  figure,  the  analog  source  which 
is  sampled  at  the  rate 

R  =  ~  =  2B 
T 

S 
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In  fact  B  =  4  kHz  and  @B  =  32  kHz.  The  samples  are  quantized 
into  N  -  8  hits. 

The  first  two  bit  streams,  which  are  the  streams  of  the 
two  most  significant  bits,  are  encoded  by  Golay  encoders.  A 
Golay  code  takes  12  information  bits  and  puts  out  a  codeword 
of  23  bits.  The  Golay  code  has  the  property  that  it  will 
correct  all  patterns  of  three  or  less  errors  which  occur  in 
the  pattern  of  twenty  three.  The  rate  of  the  Golay  code  is 
slightly  less  than  one  half  which  for  our  purposes  we  will 
take  as  equal  to  1/2.  The  figure  indicates  that  for  each 
bit  entering  the  encoder  two  bits  leave. 

The  remaining  streams,  that  is  streams  3-8,  receive  no 
separate  encoding.  Thus  before  the  bits  have  entered  the 
channel  signal  generator,  we  have  the  situation  where  8  bits 
from  the  A/D  have  given  rise  to  10  bits  from  the  coding  net¬ 
work. 

It  is  now  the  function  of  the  channel  signal  generator 
to  take  these  10  bits  and  transmit  them  over  that  channel 
with  the  allotted  power  and  bandwidth.  This  operation  is 
nontrivial  in  that  the  means  of  transmission  can  drastically 
alter  the  protection  provided  by  the  encoding  network.  In 
fact,  the  coding  network  and  channel  signal  generator  must  be 
designed  jointly  in  order  to  arrive  at  an  efficient  design. 
This  is  in  fact  one  of  the  causes  of  why  a  systematic  design 
procedure  is  so  difficult. 


Taking 

T 


1 


(19) 


implies  that  the  channel  signal  generator  has  8  transmissions 

of  its  basic  waveform  to  transmit  10  bits  of  information  in 

the  time  interval  T  .  This  is  accomplished  by  using  binary 

s 

transmission  to  transmit  the  bits  from  the  Golay  encoders 
and  also  using  binary  transmission  for  streams  3  and  4  with 
streams  5  through  8  being  combined  to  give  rise  to 
transmission  of  two  quaternary  signals.  Refer  to  Figure  3.5. 

With  this  scheme  the.  bit  errors,  on  streams,!  through  4 
will  occur  independently  from  stream  to  stream  while  errors 
on  streams  5  and  €  and  7  and  8  will  be  dependent. 

The  input  SNR  is  defined  as 


o 


This  can  be  rewritten  in  the  form 


2E 

N 

o 


(21) 


where  E  is  the  total  amount  of  energy  available  in  the  time 

interval  T  . 

s 

The  design  we  are  considering  allows  the  same  amount  of 
average  energy  to  each  transmission  on  the  channel.  In  gen¬ 
eral  there  are  8  transmissions  in  time  interval  T  and  this 

s 

gives  the  following  amount  of  energy  per  transmission 

E  =  E/8  =  E/8  (22) 

P 

In  order  to  further  evaluate  the  performance  of  the 
system  design  we  are  specifying,  we  must  know  more  about 
the  receiver  of  which  little  has  been  said  thus  far.  The 
receiver,  in  terms  of  equipment,  is  more  difficult  to 


43 


3-14 


implement,  however  in  terms  of  calculating  the  performance 
we  only  have  to  know  how  the  receiver  is  performing  the  pro¬ 
cesses  of  decoding  and  bit  detection. 

Ideally,  for  the  decoding  of  the  Golay  code,  maximum 
likelihood  decoding  would  be  optimal,  however  this  is  not  a 
reasonable  means  in  terms  of  hardware  implementation.  The 
simplest  means  of  decoding* is  to  decode  the  received  word  bit 
by  bit  and  then  use  a  conventional  method  of  decoding  the 
Golay  code  such  as  the  Kasami  decoder  [12]  or  a  permutation  type  of 

decoder.  The  problem  with  this  approach  is  that  several  dB 
in  performance  are  being  sacrificed  as  compared  to  optimal  de¬ 
coding. 

As  a  compromise  between  maximum  likelihood  decoding  which 
would  require  a  bank  of  1024  matched  filters  at  the  receiver 
and  conventional  bit  by  bit  decoding  we  had  decided  upon  imple¬ 
menting  a  technique  called  Weighted  Erasure  Decoding  (WED) 
developed  recently  by  Weldon  [13] .  This  technique  provides  bit 
error  performance  between  the  extremes  of  optimum  and  bit  by  bit 
and  only  requires  a  moderate  amount  of  complexity  above  what  is 
required  by  the  conventional  decoding  of  the  Golay  code  by  a 
Kasami  or  permutation  decoder. 

The  method  used  for  its  implementation  is  described 
in  Section  4.  For  the  purpose  of  calculating  the  performance 
of  MSM  we  are  primarily  interested  in  how  WED  affects  the  probab 
ility  of  a  bit  being  in  error  as  a  function  of  E^/N^,  where  E^ 
is  the  amount  of  energy  expended  per  information  bit  transmitted 
This  information  is  shown  in  Fig.  3.6,  which  is  taken  from  [13] 

*  This  is  referred  to  a  decoding  on  the  basis  of  hard  decision. 
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Eb/N0  dB 

Fig.  3.6  Performance  of  Weighted  Erasure  Decoding  of  the 
123,12)  Golay  Code  for  Various  Degrees  of  Quanti 
zation,  (from  Weldon  Fl3 3 ) . 


The  parameters  associated  with  each  of  the  curves  in  the 
figure  denote  the  degree  of  quantization  employed  by  the  WED 
scheme.  In  WED  the  received  binary  transmission  plus  Gaussian 
noise  is  quantized  into  L  levels.  L  =  2  denotes  the  perform¬ 
ance  of  decoding  on  the  basis  of  hard  decisions. 

The  performance  given  by  these  curves  can  only  be  an 
approximation  to  the  performance  which  we  can  expect  from 
the  equipment  for  several  reasons.  First,  the  curves  in  the 
figure  are  upper  bounds  on  performance.  Secondly,  the  method 
of  decoding  for  which  the  curves  were  calculated  are  an  ap¬ 
proximation  to  the  way  the  equipment  performs  the  decoding. 
Thirdly,  and  perhaps  most  important,  is  that  the  curves  are 
calculated  on  the  basis  of  a  quantization  which  can  be  ad¬ 
justed  of  the  basis  of  E^/Nq,  whereas  in  the  equipment  a 
single  quantization  rule  must  be  used  for  all  values  of  E^/Nq. 
Notwithstanding  these  deviations  between  theory  and  practice, 
the  L=8  and  L=4  curves  were  used  in  the  calculations  of  per¬ 
formance  . 


Streams  3  and  4  are  transmitted  straight  binary  and  since 
the  transmission  is  synchronous  the  probability  of  a  binary 
error  on  streams  3  and  4  is  given  by  the  well  known  equation 


where 


i  =  3,  4 


-u2/2 


du 


(23) 


(24) 


The  bits  from  streams  5  and  6  are  combined  and  are  used 
to  determine  the  amplitude  of  a  quaternary  transmission.  The 
bit  pair  (5,6)  are  looked  on  as  representing  a  number  from  0 
to  three  with  the  (0,0)  pattern  giving  rise  to  the  lowest 
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transmitted  level  and  (1,1)  to  the  highest. 


Having  described  how  all  the  bits  from  the  A/D  are 
handled  we  are  now  in  a  position  to  evaluate  performance. 
We  can  write 


D°=E(i  (ai-vri) 


where  a.  =  ±1 
1 


8  8 


=  E  E  E(a.  -  a. )  (a .  -  a . )  2 
i=l  j-1  1  1  3  D 


-  (i+j) 


=  E  E(a.  -  a.)2  2-21  +  E  E  E(a.  -  a.)  (a.  -  a.) 
i=l  11  i=5  j=5  1  1  3  D 


8  8 

+  E  2  E(a.  _  i')  (a.  _  a.)  '2~(l+j)  (25) 

i=7  j=7  1  1  3  3 


We  are  able  to  break  down  the  error  term  into  this  last 
expression  because  the  probability  of  error  for  the  first  four 
most  significant  bits  are  independent  of  each  other  whereas 
the  errors  made  in  the  transmission  of  bits  a,_,  a&  ,  a?  and  a0 
are  not..  An  error  made  in  the  transmission  of  ac  is  corre- 

D 

lated  with  that  of  a&  and  similarly  the  error  occuring  in 
is  correlated  with  an.  This  occurs  because  a_  and  a,  (and  also 

O  DO 

an  and  aQ)  are  transmitted  by  a  single  quaternary  pulse. 

7  o 

The  expression  for  the  error  can  be  now  written 


D  =  4  E  4‘V  +  1.5(4~5)  P  .  +  1.5  (4~?)  P  - 

c  i=l  i  ql  q2 


(26) 


where  P^  i=l,4  is  the  probability  of  bits  i=l,4  being  in  error, 
respectively  P^  and  represent  the  probabilities  of  jumping 


-(i+j) 
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to  an  adjacent  level  in  the  two  quaternary  transmissions,  wuuuim 
level,  pacing  of  the  quaternary  signal  is  assumed  so  that  a  single 
number  characterizes  level  transitions.  We  have  neglected  the  pro¬ 
babilities  of  other  types  of  error  occurring  in  quaternary  transmis¬ 
sion.  This  assumption  is  valid  providing  that  SNR's  are  not  too  low. 

In  the  particular  case  which  we  are  considering,  where 
each  stream  has  the  same  average  energy,  we  have 

=  P2=Prob.  of  an  error  in  the  Golay  encoded  bits 
P3  =  P4  =  Prob  of  a  bit  in  error  for  straight  binary  trans. 


In  the  following  tables  are  presented,  for  a  variety  of 
p^'s,  the  bit  error  probability  for  each  of  the  bits  along 
with  its  contribution  to  Dc«  For  bit  pairs  (5,G)  and  (7,8) 
the  number  in  the  probability  of  error  column  is  the  prob¬ 
ability  that  noise  causes  a  jump  to  an  adjacent  level. 

We  see  from  the  tables  that  at  low  SNR  it  is  the  errors 
in  the  most  significant  bits  which  contribute  most  to  the 
channel  distortion.  We  can  also  see  that  the  Golay  encoded 
bits  are  somewhat  overprotected  as  compared  to  the  bits  in 
stream  3  and  4  and  that  an  energy  transfer  from  the  Golay 
bits  to  3  and  4  would  improve  the  overall  performance.  Further¬ 
more  we  see  that  we  could  achieve  a  further  improvement  in 
performance  at  low  SNR’s  by  shifting  some  of  the  energy  in  the 
quaternary  streams  to  streams  3  and  4.  However,  this  would 
have  to  be  paid  for  by  a  sacrifice  in  performance  at  high 
where  the  errors  made  in  the  quaternary  streams  dominate  the 
performance.  We  can  see  that  once  a  particular  scheme  has 
been  evaluated  the  course  one  must  take  in  achieving  a  more 
desirable  characteristic  becomes  clearer. 
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Table  1 

Elements  of  a  Performance  Calculation 


p.  =  13  dB 

E/N  =  10  dB 
o 

E/N  =  1  dB 
P  o 

Bit 

Number 

Probability 
of  Error 

Distortion 

Factor 

Contribution 
to  Dc 

1 

10-3 

1 

io“3 

2 

10-3 

2.5  x 10"1 

2.5x10  4 

3 

5.6xl0“2 

6.25X10"2 

3.5X10”3 

4 

5.6X10-2 

1.56xio"2 

8.75X10-4 

2.4x10  1  1.43  jdO-3  3,43  xLO-4 


2.4X10~1  9.14x  10“ 5  2.63x10 


3-20 


Table  2 


Elements  of  a  Performance  Calculation 


P.  =  15  dB 

X 

E/N  =  12  dB 
o 

E  /N  =  2 . 96  dB 
P  ° 

Bit  Probability 

Number  of  Error 

Di stortion 
Factor 

Contribution 
to  Dc 

1 

8  x  10  ^ 

1 

8  xlO*'6 

2 

8  x  10"6 

2.5  x  lO”1 

2xl0~6 

3 

2.29  x  10~2 

6.25  x  10”2 

1.43  x  10“3 

4 

-2 

2.29  x  10 

1.56  x  10"3 

3.57  x  10"3 

)  1.86X10"1 

1.43X10-3 

2.66  x  10"4 

6  J 

7>l 

>  1.86X10"1 

9.14x  10  5 

1.7  x  10“5 

8  J 

I 
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Table  3 


Elements  of  a  Performance  Calculation 


Pi  =  20  dB 

E/N  =  17  dB 
o 

E/N  =7.96  dB 
P  o 

Bit  Probability 

Number  of  Error 

Distortion 

a au uvi 

Contribution 

ww  uc 

i 

«io“8 

1 

2 

«io~8 

2.5x  10"1 

3 

1.92x  10"4 

6. 25x  10"2 

1 . 2x  10“5 

4 

-4 

1.92X  10 

1.56x  10"2 

-6 

3x  10 

M 

)  5.6X  10“2 

1.43x  10“3 

8x  10~5 

6  J 

j 

^  5.6x  10"2 

9.14x  10-5 

5.12x  10“6 

8  J 
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Table  4 


Elements  of  a  Performance  Calculation 


P.  =  23  dB 

l 

E/N  =  20  dB 
o 

E  /N  =  11  dB 
P  o 

Bit- 

Probability 

Distortion 

Contribution 

Number 

of  Error 

Factor 

to  Dc 

1 

«<io"8 

1 

2 

<«10-8 

2.5  x  10"1 

3 

2.98  x  10"6 

6.25  x  10"2 

1.86  x  10“7 

4 

g 

2.98x10" 

1.56  x  10“2 

4.64  x  10“8 

n 

1.24  x  10“2 

1.43  x  10"3 

1.78  x  10'5 

6  J 

1.24  x  10~2 

9.14  x  10-5 

1.13  x  10'6 
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The  performance  of  the  design  for  0=8,  in  terms  of  p 

o 

vs  is  shown  in  Fig.  3.7.  We  see  that  the  performance  of 
MSM  is  uniformly  superior  to  FM  over  the  range  of  input  SNR's 
of  interest.  In  addition  we  have  that  at  low  inputs  SNR's 
the  gain  over  FM  and  PCM  in  output  SNR  is  in  excess  of  10  dB. 
Futhermore,  we  see  that  there  is  shifting  of  the  threshold 
by  4.5  dB  over  PCM.  The  price  paid  for  this  gain  in  compari¬ 
son  to  PCM  is  that  at  high  input  SNR's  PCM  performance  is 
superior  to  MSM.  However,  the  crossover  occurs  at  such  a 
high  output  SNR  that  the  higher  quality  of  PCM  in  this  region 
is  really  not  meaningful. 

The  MSM  curve  in  Fig  ,3.7  was  derived  using  the  L=8  curve  in 
Fig.  3.6.  The  difference  in  performance  that  occurs  when  the 
L= 4  curve  is  used  in  the  calculation  is  shown  in  Fig.  3.8. 

We  can  see  from  the  figure  that  the  degradation  in  performance 
is  negligible.  This  is  due  to  the  fact  that  at  the  energy 
levels  being  used  to  transmit  the  Golay  bits  they  are  over¬ 
protected  as  we  had  previously  noted.  That  is,  a  good  part 
of  the  error  at  the  low  SNR's  comes  from  streams  3  and  4  and 
the  increase  in  error  from  the  Golay  bits  is  only  part  of  the 
distortion. 

Finally  in  regard  to  the  0=8  design  we  note  that  while 
we  have  pushed  the  modulation  characteristics  closer  to  the 
R(D)  curve  by  a  significant  amount,  as  compared  to  existing 
techniques,  the  curves  indicate  that  there  are  still  important 
gains  to  be  made.  3ased  on  our  work  to-date,  we  are  convinced 
that  we  can  achieve  further  gains  in  the  design  of  MSM. 
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E'ig.  3.8  Effect  of  Quantization  in  Decoding  on  MSM 
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3.4.2  Design  for  ft  =  4 


The  design  methods  for  0=4  is  the  same  as  for  0=8.  The 
designs  for  0=4  were  not  implemented  in  the  hardware  and 
should  be  considered  as  being  illustrative  and  not  represent¬ 
ing  finalized  designs. 

In  the  0=4  case  the  data  source  was  quantized  into  six 
bits.  The  methods  of  coding  these  bits  have  fallen  into  two 
categories:  (1)  codes  with  memory  and  (2)  codes  with  no  mem¬ 

ory.  The  no  memory  codes  just  make  use  of  an  appropriate  as¬ 
signment  of  bits  to  channel  symbols  to  provide  protection  to 
the  bits. 

When  the  various  codes  with  memory  were  tried,  it  was 
found  that  the  overall  modulation  characteristics  which 
were  obtained  were  not  necessarily  as  desirable  as  those 
which  could  be  obtained  with  no  memory  coding.  The  reason  tor 
this  is  that  the  redundancy  introduced  to  protect  the  more  im¬ 
portant  bits  can  readily  result  in  underprotection  of  the  least 
significant  bits.  For  tne  case  of  small  0,  codes  with  memory 
should  be  useful  but  it  appears  that  they  have  to  be  designed 
specifically  for  the  application  in  mind,  i.e.,  it  is  difficult 
to  select  an  efficient  code  for  this  application  from  classical 
ones,  such  as  the  Golay. 

In  the  following  figure  we  nave  illustrated  ehe  perform¬ 
ance  of  two  MSM  designs  for  0=4  that  were  analyzed. 

For  the  sake  of  comparison  an  FM  curve  with  0=4  has  also  been 
compared.  The  curve  labelled  A  gives  the  performance  for  a  no 
memory  coding  technique.  The  curve  B  is  for  a  coding  technique 
which  uses  memory.  Wnile  both  B  and  A  yield  better  performance 
than  FM  for  the  range  of  SNR's  considered,  we  see  that  B  is 
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better  than  A  at  the  low  end.  However,  the  B  curve  saturates 
rather  rapidly.  This  is  due  to  the  error  probabilities  of  the 
lower  bits  being  in  a  flat  region. 

The  design  wnich  yielded  the  A  curve  in  tne  accompanying 
figure  has  the  six  bits  from  the  input  samples  as¬ 
signed  to  two  binary  and  two  quaternary  pulses.  The  two  most 
significant  bits  were  transmitted  binary  and  tne  remaining 
four  were  quaternary.  The  quaternary  pulses  have  nonuniformly 
spaced  amplitudes  in  order  to  obtain  a  more  desirable  bit  error 
assignment.  Both  the  binary  and  quaternary  pulses  have  the 
same  average  energy  and  the  levels  of  the  quaternary  take  on 
the  values  ±t  and  ±1.6-6,  where  the  parameter  l  adjusts  the 
energy. 

The  design  which  gave  us  curve  B  used  a  Golay  code  on  the 
most  significant  bit.  Thus  for  each  six  bits  from  the  A/D 
seven  bits  were  transmitted  over  the  channel  in  four  transmis¬ 
sions.  The  seven  bits  were  transmitted  by  3  quaternary  and  one 
binary  transmission.  The  Golay  bits  were  transmitted  by  quater 
nary  signals,  the  second  most  significant  bit  was  binary  and 
the  four  remaining  bits  were  quaternary.  As  in  case  A  the 
quaternary  signals  had  nonuniform  spacing  of  its  levels.  Equal 
average  energy  was  given  to  each  transmission. 
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SECTION  IV 


DESCRIPTION  OF  BREADBOARD  EQUIPMENT 

4.1  Design  of  Breadboard  Model  and  Demonstration 

The  purpose  of  designing  and  building  a  demonstration 
breadboard  is  to  verify  that  the  theoretical  calculations  which 
have  indicated  that  Multistream  Modulation  will  outperform  con¬ 
ventional  modulation  techniques  are  correct.  Thus,  this  demon¬ 
stration  breadboard  will  serve  to  show  in  a  realistic  and  under¬ 
standable  way  just  how  good  and  how  worthwhile  in  terms  of 
communication  performance  the  new  nonlinear  modulation  tech¬ 
niques  are.  In  the  demonstration  breadboard  described  by  us  in 
this  section,  the  demonstration  can  be  run  at  a  bandwidth  expan¬ 
sions  of  8.  The  described  breadboard  design  accommodates  both  a 
conventional  modulation  technique  (PCM)  and  the  demonstration 
nonlinear  modulation  technique.  The  signal-to-noise  ratio  can  be 
varied  in  the  demonstration  breadboard,  and  is  the  basic  param¬ 
eter  under  the  experimenters  control. 

4.1.1  Format  of  the  Demonstration  Experiment 

The  demonstration  experiment  is  a  single  voice  link.  This 
voice  link  is  provided  by  either  the  nonlinear  pro¬ 
cessing  equipment*  or  by  a  comparison  standard  PCM  modulation 
system.  The  structure  of  the  experimental  system  is  shown  in 
Fig.  4.1.  Looking  at  the  figure,  you  see  on  the  left  a  micro¬ 
phone  which  feeds  a  compander,  which  is  a  gain  control  device, 
which  feeds  an  8-bit  A-to-D.  The  basic  structure,  underlying 
both  the  conventional  PCM  system,  and  the  nonlinear  system 
is  8-bit  quantized  speech. 

First,  consider  how  the  standard  PCM  modulation  technique 
is  implemented  in  this  experimental  structure.  The  output  of 
*  which  embodies  the  MSM  structure  of  Fig. 3. 5. 
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the  A-to-D  is  fed  into  the  box  labelled  PCM  data  generator.  The 
PCM  data  generator  feeds  the  reformatted  data  to  a  data  selector. 
This  data  selector  gates  the  data  from  the  PCM  data  generator 
and  directs  it  to  a  digital-to-analog  converter.  The  output 
of  the  digital-to-analog  converter  is  the  baseband  simulated 
channel,  which  is  a  PAM  channel.  Noise,  from  a  noise  generator, 
is  added  to  the  channel  signal.  The  sum  of  noise  plus  signal 
is  then  fed  into  a  detector  which  is  composed  of  a  sampler  fol¬ 
lowed  by  an  A-to-D  converter.  The  output  of  the  A-to-D  converter 
goes  to  threshold  logic  which  compares  the  A-to-D  result  with 
the  thresholds  for  the  channel  symbols.  The  output  of  the  thresh 
old  logic,  which  is  the  detector's  estimate  of  the  symbol  that 
was  transmitted  over  the  channel,  is  then  fed  to  the  PCM  data  re¬ 
constructor  which  takes  incoming  symbols  and  reformats  them  into 
the  binary  words  representing  the  digital  samples  of  the  voice 
channel.  The  output  of  the  PCM  reconstructor  is  gated  by  the 
data  selector  to  the  D-to-A.  The  D-to-A  output  goes  through 
an  expander,  which  reverses  the  effects  of  the  input  compander, 
and  finally  after  a  smoothing  filter  the  signal  goes  to  the  ear¬ 
phones.  In  order  for  this  system  to  work  the  signals  from  the 
timing  and  control  unit  must  select  the  data  and  gate  it  properly 
into  the  D-to-A.  The  timing  transmitted  to  the  PCM  encoders  and 
decoders  must  correspond  to  the  timing  sent  to  the  channel  trans¬ 
mission  and  channel  detection  logic. 

The  experimental  structure  in  Fig.  4.1  shows  also  an 
alternate  data  path.  This  path,  rather  than  using  the  PCM 
data  encoder,  uses  the  data  encoder,  and  rather  than  using 
the  PCM  data  reconstructor,  uses  the  data  reconstructor. 

Now,  the  data  generator  takes  as  input  the  voice  samples 
from  the  A-to-D  and  delivers  as  output,  specifications  of  the 
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data  symbols  to  be  transmitted  over  the  channel.  Computations 
performed  in  the  data  generator  effectively  calculate  the  symbols 
of  the  nonlinear  modulation  scheme  and  report  these  outputs  to 
the  data  selector,  which  then  passes  them  on  to  the  channel.  At 
the  output  of  the  channel  threshold  logic,  the  received  data  sym¬ 
bols  from  the  channel  are  transmitted  to  the  data  reconstructor. 

This  data  reconstructor  looks  at  the  received  sequence  from  the 
channel  and  constructs  an  estimate  of  the  voice  data  that  were 
actually  present  at  the  transmission  end.  The  output  of  the  data 
reconstructor  is  fed  to  the  data  selector  and  from  there  can  be 
gated  to  the  D-to-A  and  finally  to  the  expander  and  earphones. 

We  have  not  shown  in  Fig.  4.1  the  error  measuring  circuit. 

This  circuit  performs  a  digital  subtraction  of  the  8-bit  output  of 
the  input  A-to-D  from  the  finally  reconstructed  8-bits;  that  is 
the  digital  8-bit  word  at  point  A  is  subtracted  from  the  digital 
word  at  point  B.  The  digital  difference  is  then  fed  to  a  converter 
whose  output  is  fed  to  an  RMS  module  which  contains  a  squarer,  integrator 
and  square  router  and  yields  the  RMS  value  of  the  error  as  an  out¬ 
put  voltage. 

4.1.2  Structure  of  the  Demonstration  Breadboard 

The  most  important  feature  of  the  demonstration  breadboard 
is  the  fact  that  basic  subcomponents  including  the  input  compander 
and  filtering,  the  input  A-to-D  converter,  the  output  D-to-A 
converter,  the  output  expander  and  the  channel  data  transmitter 
are  all  the  same  whether  a  non-linear  modulation  scheme  is  being 
used,  or  whether  the  conventional  PCM  modulation  is  being  used. 

The  purpose  of  this  great  degree  of  commonality  is  to  reduce  the 
effect  of  uncontrolled  variables  so  that  the  experiment  will  be 
valid  and  will  compare  the  features  of  the  non-linear  modulation 
scheme  with  the  features  of  a  standard,  well-understood  and  well- 
known  modulation  technique.  A  second  factor  in  the  experimental 
design  structure  is  that  such  common  use  of  components  results  in 
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reduced  experimental  expense,  while  at  the  same  time  providing  a 
better  experiment.  The  third  point  in  the  experimental  structure 
is  the  absence  of  synchronization  problems.  The  timing  and  con¬ 
trol  shown  in  Fig.  4.1  is  uniform  and  comes  from  a  central  source 
for  both  the  transmission  and  reception  sections.  This  is  a  part 
of  the  true  transceiver  problem  which  is  not  being  modelled. 

However,  this  is  not  a  defect  in  the  experimental  structure, 
rather  it  is  a  simplification.  The  same  effects  apply  to  both 
the  conventional  modulation  scheme  as  well  as  the  experimental 
non-linear  modulation  scheme  so  that  there  is  no  unequal  comparison 
in  the  experiment,  but  rather  the  effects  of  the  experiment  have 
been  localized  so  that  it  is  truly  just  signal-to-noise  ratio  that 
is  important.  Secondly,  synchronization  equipment  would  be  expen¬ 
sive  in  material  costs  and  in  labor-time.  Until  the  performance 

and  design  of  nonlinear  modulation  were  proven  there  was  no  point 
to  add  such  complications  to  the  experiment  although  future 
investigation  of  system  trade-offs  must  include  the  synchroniza¬ 
tion  problem. 

Because  of  the  considerations  mentioned  above,  the  timing 
and  control  logic  for  both  the  transmitter  and  receiver  in  the 
simulated  data  link  system  are  unified  to  simplify  the  experiment 
and  to  save  expenses. 

PCM  was  chosen  as  the  conventional  modulation  scheme  to  be 
incorporated  in  this  system  for  several  reasons.  First,  it  is 
well-known,  used  extensively  on  many  communication  links,  and 
is  (as  explained  in  another  section  of  this  report)  a  very  good, 
effective  system  of  bandwidth  expansion.  It  would  not  be  reasonable 
to  compare  a  new  nonlinear  modulation  technique  with  anything  but 
a  conventional  modulation  technique  which  itself  is  effective.  Sec- 
condly,  PCM  allows  us  to  have  an  easily  structured  experiment  which 
will  generate  honest  comparisons.  The  use  of  PAM  on  the  channel  was 
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selected  because  it  has  a  simple  inplementation  and  can  be 
readily  analyzed  and  simulated  during  the  design  phase.  Clearly 
the  output  from  the  data  selector  which  selects  the  channel 
symbol  could  just  as  easily  feed  into  a  PSK  modulator,  or  an 
FSK  modulator.  There  is  no  particular  restriction  on  channel 
modulation  scheme  except  that  in  the  laboratory  it  is  very  easy 
to  model  the  PAM  channel. 


The  input  signal  to  the  system  comes  either  from  a  micro¬ 
phone  or  a  tape  recorder  and  is  fed  into  the  compander  and  filter. 
The  filter  limits  the  input  to  the  A-to-D  converter  to  frequencies 
below  4  KHz.  The  A-to-D  converter  is  driven  at  8  kilosamples  per 
second,  which  is  the  Nyquist  rate  for  the  output  of  the  filter. 


These  data  samples  from  the  A-to-D  go  to  both  the  PCM  data 
generator  and  the  data  generator.  These  data  generators 
prepare  specifications  of  channel  symbols  from  the  input  data 
words  and  transmit  these  specifications  to  the  data  selector. 

The  data  selector  is  controlled  by  the  timing  and  control  logic, 
and  depending  upon  whether  we  are  running  in  the  PCM  mode  or  the 
non-linear  modulation  load,  selects  the  data  from  the  PCM  data 
generator,  or  selects  the  data  from  the  data  generator, 
and  feeds  this  data  (really,  at  this  time  a  channel  symbol  specifi¬ 
cation)  to  the  D-to-A  converter  where  a  channel  symbol  is  created. 
One  special  feature  of  our  design  is  that  this  D-to-A  converter 
has  a  higher  bit  capacity  than  the  symbols  on  which  it  operates 
in  order  to  provide  variable  energy  assignment  to  different  bits. 


The  channel  symbol  is  put  on  a  simulated  channel,  noise  is 
added  to  it,  and  it  is  fed  to  a  sampler.  The  output  of  this 
sampler  goes  to  an  A-to-D  converter  which  produces  a  digitized 
result.  The  digital  result  goes  to  a  threshold  logic  box  which 
compares  the  received  channel  level  with  the  thresholds  associated 
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with  various  channel  symbols,  and  produces  an  estimate  of  the 
received  channel  symbol.  This  estimate  is  then  fed  into  the 
PCM  data  reconstructor  and  the  data  reconstructor. 

These  data  reconstructors  take  as  input  the  streams  of  received 
channel  symbols  and  produce  as  output  estimates  of  the  digital 
words  that  were  input  to  the  data  generators.  The  output  of  the 
data  reconstructors  is  fed  to  a  data  selector  which  chooses  the 
proper  output  depending  upon  the  mode  the  breadboard  is  in. 

The  output  word  is  fed  to  a  D-to-A  converter  which  reconstructs 
an  analog  signal.  This  analog  signal  is  then  fed  to  an  ex¬ 
pander  and  then  to  the  earphones. 

Bandwidth  expansion  is  defined  by  the  mapping  that  the 
data  generators  create  between  their  input  symbols  and  their 
output  symbols.  For  instance,  if  the  PCM  that  is  used  is  a 
straight  8-bit  PCM,  then  for  every  digital  sample,  or  8-bit 
A-to-D  output  of  the  PCM,  eight  single  pulses  will  be  deliver¬ 
ed  to  the  data  selector  and  eight  single  pulses  will  be  trans¬ 
mitted  over  the  channel.  Thus  a  bandwidth  expansion  of  eight  is 
achieved.  At  the  receiving  end,  for  every  eight  pulses  that  are 
decoded  by  the  threshold  logic  and  fed  to  the  PCM  data  recon-- 
structor,  one  word  of  data  will  come  out  of  the  data  reconstructor. 

The  detection  logic  is  composed  of  a  sampler  followed  by  an 
A-to-D,  followed  by  a  digital  thresholding  operation.  The  pur¬ 
pose  of  using  the  digital  thresholding  operation  together  with  an 
A-to-D  converter  was  to  simplify  the  variability  of  the  threshold 
logic  and  to  allow  a  variety  of  symbol  detection  options  depend¬ 
ing  upon  what  encoding  technique  is  being  used  at  the  output  of 
the  data  generator. 

The  function  of  the  data  reconstruction  has  been  mentioned 
several  times  before.  Essentially  the  data  reconstructors 
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translate  from  the  received  channel  symbols  back  to  the  digitized 
voice  samples.  For  instance,  if  the  system  is  operating  as 
straight  PCM,  then  the  PCM  reconstructor  takes  in  eight  serial 
bits  and  produces  as  output  an  eight-bit  sample  which  is  then 
transmitted  into  the  data  selector .  The  data  selector  would 
transmit  it  on  to  the  D-to-A  converter  if  the  breadboard  were 
operating  in  the  PCM  mode.  The  function  of  the  other  components 
in  the  system,  the  data  selector,  the  D-to-A  and  the  expander 
have  all  been  discussed  above. 

The  timing  and  control  box  generates  those  clock  and  command 
signals  necessary  to  make  each  of  the  described  units  function 
as  desired.  For  many  of  the  units,  the  timing  and  control  is 
quite  simple.  For  instance,  for  the  A-to-D  and  D-to-A,  these 
control  signals  are  essentially  pulses  at  the  sampling  rate. 

For  some  of  the  ocher  equipment,  the  control  is  somewhat  more 
complicated. 

We  have  thus  far  presented  the  overall  structure  and  con¬ 
cept  of  the  breadboard  design.  In  the  following  section  we 
have  presented  a  more  detailed  function  description  of  the  bread¬ 
board  design. 

4.2  Functional  Description  of  Multistream  Modulation  Breadboard 
4.2.1  Transmitter  Description 

Two  modes  of  operation  are  available:  A  straight  PCM  and 
MULTISTREAM  Modulation  which  will  be  designated  as  MSM.  The  data 
source  can  be  either  voice  or  a  random  signal  which  will  be 
designated  PRN  (Pseudo  Random  Noise) .  The  message  unit  is  8- 
bits  of  information (i.e. ,  voice  sample  quantized  into  8-bits). 
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For  the  PCM  mode  the  transmission  levels  are  a  fixed  analog 
level  for  a  1  and  an  opposite  signed  level  of  equal  magnitude 
for  a  0.  For  MSM  bits  1  to  4  are  transmitted  in  the  same  man- 
mer  (including  the  Golay  code  check  bits).  For  bit  pairs  (5,6) 
and  (7,8)  a  four  level  analog  signal  (2  positive  and  2  equal 
magnitute  but  negative  values)  is  transmitted. 

4. 2. 1.1  PCM  Operation  (Refer  to  Fig.  4-2) 

The  8  bit  message  units  are  sent  serially  out  via  the  4  bit 
level  selector  and  the  output  D-to-A.  The  4  bit  level  selector 
selects  the  proper  positive  or  negative  4  bit  digital  number 
(to  be  converted  tc  analog  positive  or  negative  levels) ,  cor¬ 
responding  to  the  l's  or  0's  in  the  message. 

4. 2. 1.2  MSM  Operation  (Refer  to  Fig.  4-2) 

The  eight  bit  message  is  broken  into  the  following  parts: 
bits  1  and  2  (most  significant  bits)  are  sent  to  a  Golay  Encoder. 
Bits  3  and  4  are  transmitted  unmodified.  Bits  5  and  6  are  com¬ 
bined  and  the  four  different  combinations  resulting  from  these 
two  bits  (i.e, , 00, 01, 10,11)  are  transmitted  by  four  analog  levels. 
Bits  7  and  8  are  processed  like  bits  5  and  6. 

The  Golay  code  is  a  23  bit  code,  the  first  twelve  bits  of  which 
are  the  data  followed  by  ^leven  check  bits  generated  by  the 
coder.  Since  only  the  first  and  second  most  significant  bits  of 
the  message  unit  are  to  be  encoded  it  takes  six  such  messages  in 
order  to  accumulate  twelve  data  bits  to  fill  the  code. 

Bits  3  and  4  of  these  six  messages  are  meanwhile  assembled  in¬ 
to  six-bit  accumulators.  Bits  5,6,7,  and  8  are  processed  in  the 
same  manner.  At  the  end  of  six  such  eight  bit  message  units,  the  con¬ 
tents  of  the  Golay  encoder  and  the  six  above  mentioned  accumulators 
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Fig.  4.2  Functional  Block  Diagram  of  Transmitter 


are  transferred  to  buffers  and  the  cycle  repeats.  Meanwhile 
the  data  stored  in  these  buffers  are  transmitted  serially  start¬ 
ing  with  the  23  Golay  information  followed  by  the  six  bits  of  bit 
stream  number  3  etc. 

The  levels  chosen  for  transmission  are  determined  by  the  four 
bit  level  selectors  shown  in  the  block  diagrams.  These  selectors 
convert  a  1  or  0  level  into  a  four  bit  digital  number  which  serves 
as  the  input  to  the  output  D-to-A.  The  only  exceptions  are  the 
four  level  selectors  for  bit  numbers  5,6,7,  and  8.  In  these 

selectors  the  conversion  is  from  two  input  bits  to  a  four  bit  output 
number.  Thus  the  twelve  bits  in  the  bit  number  5  and  6  buffers  are  com¬ 
bined  to  form  six  output  bits  which  as  mentioned  above  are  trans¬ 
mitted  as  a  four  level  signal  (this  will  be  designated  from  here 
on  as  a  Multi  Level  Signal) .  The  same  process  occurs  in  bits 
7  and  8. 

The  transmitter  is  so  designed  that  these  level  selectors 
are  easily  changeable  (by  means  of  wire  jumping)  so  as  to  faci¬ 
litate  experimentation  with  different  transmission  power  level 
assignments.  The  voltage  range  of  the  D-to-A  output  is  about 
+  4.5  volts  and  the  level  selector  allow  choosing  eight  positive 
and  eight  negative  binary  levels  within  this  range.  The  D-to-A  is 
of  the  l's  complement  type. 

The  system  samples  the  input  wave  form  at  a  rate  of  8  KHz. 
Since  there  are  8  bits  per  sample  the  output  information  rate 
is  8  x  8  =  64  KHz.  The  microphone  input  is  amplified  and  is 
limited  to  3.3  KHz  3dB  bandwidth  by  the  6  pole  low  pass  Butterworth 
filter.  Therefore  the  sampling  rate  satisfies  the  Nyquist 
criterion.  The  filter  output  is  then  processed  by  a  compander 
which  amplifies  low  level  signals  more  than  higher  level  signals 
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which  is  a  common  practice  in  audio  transmission  systems.  (In 
the  receiver  section  the  processed  signal  is  expanded  back  to 
the  original  waveform) .  Means  are  also  available  to  input  an  audio 
sine  wave  (9  Volts  peak-to-peak) to  the  A-to-D  thus  by-passing 
the  voice  input  circuitry.  When  operating  in  the  random  bit  mode 
the  input  is  taken  from  random  bit  generator  (PRN)  and  the  S  bit 
samples  are  given  directly  in  digital  form  by  passing  the  input 
A-to-D. 

Finally  noise  is  added  algebraically  to  the  analog  transmitted 
value  from  an  audio  random  generator.  The  combined  signal  is  then 
sent  to  the  processing  in  the  receiver. 

4.2.2  Receiver  Description 

The  receiver  operates  in  two  modes:  PCM  and  MSM  as  described 
in  the  Transmitter  section.  The  noisy  input  signal  is  processed 
and  compared  to  the  original  undisturbed  signal.  When  the  signal 
is  a  random  bit  stream  the  difference  between  the  signals  is  meas¬ 
ured  by  <\n  RMS  instrument  and  indicates  quantitatively  the  per¬ 
formance  of  the  different  modes  of  operation  (i.e.,  MSM  vs. PCM) . 

An  audio  amplifier  for  driving  earphones  is  supplied  for  listen¬ 
ing  to  voice. 

An  interesting  feature  of  the  Golay  decoder  incorporated  in 
the  receiver  is  that  it  utilizes  soft  decision  of  the  received 
noisy  code  bits  to  improve  code  performance .  We  use  the  algorithm  given 
by  Weldon,  which  increase  theorati  cally  the  Golay  decoder  capabil¬ 
ity  to  correct  bits.  This  scheme  (Weldon  algorithm)  creates  a 
3  bit  digital  number  out  of  every  noisy  Golay  bit  received  to 
create  three  23  bit  registers.  The  Golay  decoder  decodes  sepa¬ 
rately  each  one  of  these  three  23  bit  registers  to  give  three  li  bits 
registers  of  decoded  data.  The  Weldon  algorithm. generate  •»  the  final 
12  data  bits  from  the  content  of  these  three  registers. 
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4 . 2 . 2 . 1  PCM  Operation  (Refer  to  Fig.  4.3) 

The  PCM  mode  is  straightforward.  Since  no  coding  is  involved 
the  input  A-to-D  MSB  (Most  Significant  Bit)  line  serves  as  the  input 
to  an  eight  bit  accumulator  that  assembles  an  eight  bit  message. 

When  eight  bits  have  been  assembled  they  are  transferred  to  a  buffer, 
the  output  of  which  is  fed  to  the  voice  D-to-A  via  the  PCM/MSM  selector. 

Each  8  bit  message  unit  processed  by  the  receiver  is  compared 
to  the  original  8  bit  message  which  is  sent  directly  from  the  trans¬ 
mitter  as  a  binary  pulse  stream  over  a  noiseless  link.  This  com¬ 
parison  is  done  in  the  Coincidence  Detector  which  is  an  eight  bit 
arithemetic  subtracter.  Eight  bits  of  the  original  data  are  assembled 
serially  and  are  subtracted  from  the  eight  bit  message  unit  just  pro¬ 
cessed  by  the  receiver.  The  difference  quantity  is  converted  to  an 
analog  value  and  sent  to  the  RMS  module.  The  RMS  module  output  is  a 
DC  voltage  equal  to  the  RMS  value  of  the  error  signal.  Note:  Be¬ 
cause  of  the  characteristics  of  the  RMS  module  the  meter  required  for 
error  measurements  can  be  a  simple  DC  meter.  If  the  meter  reading 
is  zero  it  means  that  the  received  processed  signal  is  identical  to 
the  original  signal  (this  of  course  is  the  case  when  no  noise  is 
added  to  signal  path  between  the  transmitter  and  the  receiver.  The 
SNR  meter  serves  to  measure  and  thus  compares  the  PCM  and  MSM  per¬ 
formance.  In  the  above  two  modes  the  test  can  be  performed  on  data 
which  is  generated  either  by  a  sine  wave  or  random  bit  generator. 

In  the  present  embodiment  of  the  receiver  the  timing  and  syn¬ 
chronizing  pulses  are  derived  from  those  of  the  transmitter  by 
means  of  direct  wires  connecting  the  two.  A  possible  future  ver¬ 
sion  could  be  incorporating  a  sync  bit  in  the  transmission  cycle 
by  stuffing  a  sync  bit  into  the  Golay  codeword.  The  Golay  code  take 
12  bits  into  23  bits.  We  can  make  it  24  bits  by  making  the  24th 
bit  a  sync  bit. 
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Functional  Block  Diagram  of  Receiver 


4. 2. 2. 2  MSM  Operation  (Refer  to  Fig.  4«3) 


The  input  signal  is  quantized  in  the  input  A-to-D  into  2  four  bit 
binary  offset  number.  Every  transmission  cycle  contains  47  bits, 
the  first  23  of  which  are  the  Golay  code  bits. 

A  soft  dec-  ion  quantizer  divides  the  16  possible  states  of 
the  4  bit  input  number  into  8  regions  designated  000  to  111.  This 
3  bit  number  is  stroked  into  the  input  of  3  shift  registers,  23 
bit  long  each.  In  the  block  diagram  110  r’unber  is  shown  as  an 
example.  This  is  the  soft  decision  representation  of  the  received 
23  bit  Golay  code  word.  The  above  mentioned  8  regions  are  alter¬ 
able  so  that  the  effect  of  different  tests  can  be  conducted.  Thus 
the  8  regions  represented  by  the  3  bit  number  are  not  necessarily 
equal  and  therefore  the  8  states  (i.e.,  -0)0' to  111)  merely  rep¬ 
resent  a  region  and  not  a  numerical  mag  :ude. 

Bits  3  and  4  (referring  to  the  transmitter  eight  bit  unit  message) 
of  the  transmission  that  occupy  the  next  twelve  bits  in  the  47  bit 
transmission  cycle  and  are  shifted  serially  into  two  six  bit  accumu¬ 
lators.  Since  bits  3  and  4  are  not  encoded  in  any  manner  in  the 
transmitter  there  should  be  a  one  to  one  relationship  between  a 
transmitted  bit  and  a  bit  stroked  into  these  accumulators.  For 
this  reason  it  is  the  MSB  bit  of  the  receiver  output  A-to-D  which 
serves  as  the  input  data  line  to  these  accumulators.  (With  the 
absence  of  noise  the  MSB  state  will  be  exactly  the  transmitted  data) . 

The  multi-level  transmission  of  bit  5,  6,  7  and  8  (the  next 
12  bits  of  the  47  bit  cycle)  is  decoded  back  via  the  comparators 
and  bits  5,  6,  7,  and  8  decoded  and  stroked  into  four  six-bit  accu¬ 
mulators  that  contain  bit  5,  6,  7,  and  8  chains  respectively. 

At  the  end  of  a  47  bit  transmission  cycle  the  contents  of  all 
these  accumulators  are  transferred  to  six  6  bit  buffers.  However 
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the  contents  of  the  3  x  23  registers  containing  the  soft  decision 
Golay  bits  are  transferred  to  the  Golay  decoder  right  after  they 
have  been  filled  out.  A  new  cycle  repeats  the  above 
steps . 

The  time  allotted  for  the  decoding  is  the  time  of  bits  13 
through  47  of  the  transmission  cycle.  While  the  decoder  ouput 
is  read  out,  the  contents  of  all  the  accumulators  are  transferred 
to  the  two  6  bit  buffers  that  contain  now  the  original  bit  1  and 
2  of  six  consecutive  message  units. 

The  result  of  all  this  is  to  have  eight  six  bit  buffers  con¬ 
taining  48  bits  of  the  six  consecutive  eight  bit  message  units. 

To  retrieve  these  six  8  bit  samples,  the  first  bit  in  line  from 
]  each  of  these  eight  Register-Buffers  is  taken,  in  the  appropriate 

|  order,  and  fed  into  D-to-A  thus  reconstructing  the  original  wave- 

j  form.  The  rest  of  the  five  groups  in  the  buffers  are  shifted  out 

and  processed  in  the  same  way.  The  D-to-A  conversions  occur  at  a 
'  rate  of  8  KHz  which  is  the  transmitted  sampling  rate.  The  D-to- 

A  output  is  expanded  (reversing  the  transmitter  companding  process) 
filtered  and  amplified  so  that  the  output  can  be  listened  to. 

Golay  Decoder  Description 

The  Golay  decoder,  as  we  have  preciously  noted  follows 
the  algorithm  of  T-Kasami  C123  along  with  soft  decision  tech¬ 
nique  of  Weldon  [133. 


4 . 3  Instructions  for  Making  Signal-to-Noise  Measurements  with 
Multistream  Modulator 

4.3.1  Introduction 

In  order  to  evaluate  performance  of  the  multi stream  modu¬ 
lator  and  also  the  PCM  system,  there  are  two  basic  signal-to-noise 
neasurements  which  must  be  made.  One  is  the  ratio  of  the  average 
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signal  power  to  the  average  error  power  and  the  second  is  the 
ratio  of  the  average  transmitted  power  to  the  average  channel 
noise  power  in  the  bandwidth  of  the  modulating  signal.  The  latter 
signal-to-noise  ratio  we  designate  as  p^  or  the  input  signal- to- 
noise  ratio.  The  former  we  designate  as  pQ  the  output  signal- 
to-noise  ratio. 

4.3.2  Measurement  of  p.  Input  Signal- to-Noise  Ratio 

The  first  step  in  the  measurement  of  p^  is  the  measurement 
of  the  received  signal  power.  For  this  measurement  we  have 

a.  The  noise  input  switch  in  the  off  position, 

b.  The  performance  measurement  switch  at  the  receiver 
input  position, 

c.  A  voltmeter  is  connected  to  the  rms  level  connector. 

The  square  of  this  rms  voltage  reading  is  proportional  to 
the  average  transmitted  power.  This  reading  will  remain  the  same 
with  the  modulation  switches  in  the  MSM  or  the  PCM  position. 

The  next  step  of  the  measurement  procedure  for  Pi  is  the 
measurement  of  the  noise  power  entering  the  receiver.  In  order 
to  carry  out  this  measurement,  the  following  steps  have  to  be 
taken . 

a.  The  signal  cable  carrying  the  signal  from  the  trans¬ 
mitter  to  the  receiver  must  be  disconnected. 

b.  The  noise  input  switch  should  be  put  in  the  ON  posi¬ 
tion. 

c.  The  performance  measurements  switch  remains  at  the 
receiver  input  position. 

The  voltmeter  reading  will  now  give  the  rms  value  of  the 
noise  entering  the  receiver.  Let  denote  the  rms  signal  volt¬ 
age  and  denote  the  rms  noise  voltage.  In  terms  of  these  two 


4-17 


75 


quantities  the  input  signal- to-noise  ratio  is  given  by  the  equa¬ 
tion 


this  equation  follows  from  the  fact  that  we  can  write 


pi  = 


2E 

£ 

T 


we  have  from  our  measurements  that  E  -  a  and  that 

s  s 

fo_  2 

2  an‘ 

4.3.3  Measuring  the  Output  Signal-to-Noise  Ratio 

Computation  of  pq  involves  knowing  the  average  power  of  the 
signal  process  x  (t)  and  the  average  power  of  the  error  which 
we  will  denote  by  e  (t) .  For  the  purpose  of  our  measurements 
we  consider  only  the  input  consisting  of  uniformly  dis  - 
tributed  random  samples  occurring  at  an  8  KHz  rate  .  These 
samples  are  generated  internally  in  the  transmitter.  They  are 
uniformily  distributed  from  -5  to  +5  volts.  The  average  power 
of  the  signal  process  we  are  considering  is  proportional  to  the 
variance  of  these  samples.  The  variance  of  these  samples  is 
given  by  equation 


TF  ■  3-” 

The  second  quantity  which  we  need  for  our  calculation  is 

equal  to  the  variance  of  the  error  in  the  reconstruction  of  these 
samples.  This  variance  quantity  is  obtcdned  in  the  following 
manner . 
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a.  Signal  output  of  the  transmitter  is  connected  to 
the  signal  input  terminal  on  the  receiver. 

b.  The  noise  generator  is  connected  to  the  noise  generator 
input  and  the  noise  which  is  turned  on. 

c.  The  performance  switch  is  turned  to  the  position  say¬ 
ing  "error  signal". 

d.  The  input  switch  is  put  on  random. 

The  rms  voltage  which  is  now  read  from  the  meter  which  we 
shall  call  c  is  the  rms  error  in  reconstructing  the  transmitted 
samples.  The-  output  signal-to-noise  ratio  in  dB  is  given  by  the 
equation 


p  =20  log  c 
o  x 

c 

e 

A  photograph  of  the  breadboard  of  a  MSM  modem  is  shown 
in  Fig.  4.5. 

4.4  Experimental  Results 

The  following  figures  show  the  results  of  the  measurements 
made  in  accordance  with  the  procedures  described  in  the  preced¬ 
ing  section.  The  results  of  the  measurements  show  a  high  ^ 
of  agreement  with  the  theoretical  predictions.  The  vol 
measurements  were  made  with  a  Simpson  VOM,  Model  260,  Seriet  j. 

In  the  MSM  experimental  results  the  major  sources  of  error 
are:  meter  accuracy;  the  overly  optimistic  performance  predic¬ 
tions  of  the  Weldon  curves;  the  suboptimality  of  soft  decision 
levels.  Due  to  the  closeness  of  the  measured  data  with  the 
theoretical  curves  it  is  difficult  to  pinpoint  which  source  of 
error  was  responsible  for  the  small  discrepancy. 
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In  the  PCM  experiment  the  major  source  of  error  is  meter 
accuracy.  Again,  experimental  results  confirm  the  theoretical 
predictions. 


SECTION  V 


SUMMARY  AND  CONCLUSIONS 

In  this  report  we  have  demonstrated  that  there  is  much  to 
be  gained  in  the  development  of  new  nonlinear  modulation  tech¬ 
niques.  The  particular  approach  we  have  taken,  which  we  have 
called  Multistream  Modulation  (MSM)  has  shown  itself  to  be  a 
particularly  useful  and  flexible  technique. 

Based  upon  the  MSM  approach  we  arrived  at  a  design  to  be 
implemented  which  has  a  desirable  performance  characteristic 
at  low  signal-to-noise  ratios,  providing  a  4.5  dB  improvement 
in  threshold  performance  over  conventional  PCM. 

The  MSM  design  was  implemented  together  with  a  conventional 
PCM  design  on  a  single  chassis  using  many  parts  in  common.  The 
resulting  piece  of  equipment  was  essentially  a  prototype  of  a 
digital  transceiver  for  implementing  digital  modulation  techniques 
for  analog  data. 

The  incorporation  of  the  PCM  together  with  the  MSM  on  a 
single  chassis  simplified  many  problems  in  the  performing  of 
experiments.  The  most  notable  advantage  was  the  ability  to  switch 
from  PCM  to  MSM  instantaneously,  while  using  a  voiae  input.  This 
permitted  immediate  side-by-side  comparisons.  As  indicated  in 
Section  4,  the  experimental  results  agreed  quite  well  with  pre¬ 
dictions.  The  improvement  exemplified  by  measurements  was  also 
true  for  voice  as  was  indicated  by  the  informal  voice  tests  which 
were  carried  out. 

An  important  result  of  this  research  effort  lies  in  our  un¬ 
covering  a  new  direction  which  offers  the  potential  for  real  gains 
in  the  performance  of  communication  systems.  Among  the  many 
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possible  areas  in  which  this  research  effort  may  be  continued 


are: 


(1)  development  of  techniques  for  the  systematic  design 
of  desired  performance  characteristics; 

(2)  development  of  specific  modulator  designs  for  dif¬ 
ferent  channels,  different  bandwidth  expansions 
and  different  performance  characteristics; 

(3)  the  design  of  codes  which  account  for  channel  char¬ 
acteristics  and  transmission  waveforms; 

(4)  design  of  coding  networks  which  operate  efficiently 
on  input  bits  of  different  significance. 
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